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Abstract: It is shown that (n , k ) convolutional codes with unit memory always 

o o 

achieve the largest free distance among all codes of the same rate k /a and 
Mk o 

» »me number 2 of encoder states, where M is the encoder memory. A unit- 

memory code with maximal free distance is given at each place where this free 

distance exceeds that of the best code with k Q and n Q relatively prime, for all 

Mk < 6 and for R «* 1/2, 1/3, 1/4, 2/3. It is shown that the unit-memory codes 
o — 

are byte-oriented in such a way as to be attractive for use in concatenated 
coding systems. 


* This research was supported by the National Aeronautics and Space 
Admii istration mder NASA Grant NSG 5025 at the University of Notre 
Dame in liaison with the Goddard Space Flight Center. 
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I. INTRODUCTION 

Let the binary k Q - tuple a^ denote the subblock of information digits 

at time t (t ■ 0, 1,2,...), and let the binary n Q -tuple b^ denote the encoded 

subblock at time t in an (n , k ) convolutional code. Then, the encoding 

o o 

equations may be written 

^ " Aj Gq + ^t-l G l + ••• + ^t-M G M (t " ^*2 » • • •) (!) 

where each G. is a k x n binary matrix, where M is the code memory, where 
i o o 

the operations are in GF (2) , and where, by way of convention, a^ ■ 0 for 

t < 0. An encoding circuit is shown in Figure 1. Note that the encoder has 
Mk 

2 ° distinct states where the state is taken as the contents of the delay cells 

in the encoder. V.e shall refer to the number Mk of binary state variables in 


the encode** =>8 the state-complexity of the convolutional code. 



Fig. 1: An encoding circuit for an (n , k ) convolutional 

o o 

code with memory M. 
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The constraint length K (measured in information digits) of the convo- 
lutional code is defined by 

1C - (M + l)k 


The rate K of the code is def. 


R - k /n . 
o o 


by 


In virtually all past applications of convolutional codes, k Q and n o have been 
takei ».• relatively prime, i.e., ged (k Q , n^) “ 1 where "ged" denotes "greatest 

common divisor'.' In fact, the condition ged (k^, n Q ) ■ 1 Is generally tacitly 

assumed so that speaking, for instance, of a convolutional code as being of 

rate R - 1/2 would imply k = 1 and n - 2 unless the contrary were explicitly 

o o 

stated. As will be seen, however, there can be advantages in taking 
ged (k Q , n Q ) > 1. 

For convenience, A et denote the encoded sequence [b^ : k t+ i : 

over time units t through t' and let b r _ . denote the entire semi-inf initt 

10 ,®) 

encoded sequence. Let a^ and a^ ^ be similarly define... The free dist ance, 

d, , of the convolutional code is the minimum Hamming distance between all 
free* 

pairs of encoded sequences b^ resulting from pairs of information sequences 
-[0 ®) Lhat differ in their time 0 subblock. By the linearity of (1), it 


follows that 


d f ■ min W(b, .) 
free ^ -[0,») 


( 2 ) 


where W(*) denotes the Hamming weight of the enclosed binary sequence and where 

the minimization is over all a,. . such that a^O. The code is non-catastrophic 

—[0,®) -O'— 

[1,2] when W(a r .) « ® implies that W(b f „ .) - ®, in which case the minimization 

-[ 0 ,®) - 10 ,“) 

in ft) reduces to the minimum over all a f _ . such that a-,40 and W(a,„ .) < ®. 

— 10 ,®) -0 —[ 0 ,®) 

The restriction to non-catasL tophi c codes entails no loss in the achievable value 
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of d, for given n , k and M, a fortunate situation because the non- 
free ® o o 

catastrophic property is essential In applications (cf. [1]). 

Because d^ ^ Is the primary determiner of decoding error probability 

when Viterbl [i.e., maximum likelihood] decoding is used with a non-catastrophlc 

code, df rce I s the usual criterion of goodness for codes to be used with Viterbi 

decoders. Because the number of states of the Viterbi decoder [5] coincides 

Mk 

with the number of encoder states, viz. 2 , practicality dictates a small 

state-complexity. The region Mk Q <_ 6 appeart to be about the range where 
Viterbi decoding is attractive in applications. Thus, for Viterbi decoding 
applications, we are motivated to find, for a given code rate and a given state- 
complexity in the above range, a convolutional code with maximum d^^. In 
the next sec* ion, we report the results of our search for such codes and we 
also derive a useful upper bound on the attainable d^ g . 

II. UNIT-MEMORY CODES WITH MAXIMAL d 

Any (n , k ) convolutional code with memory M can be considered ns an 

(n' - Mn , k' ■ Mk ) code with M' ■ 1 simply by taking 
o o o o 


G 0 


L 0 


and 


G i- 


'M 


M-l 


- G 1 


0 

Si 

G„ 


M-l 

Si- 2 


G 0 J 


0 

0 

l 


These two codes a^e entirely equivalent in the sense that the same semi-ii. finite 
binary information sequence produces the same semi-infinite binary encoded 
sequence, although the division into time subblocks would be different. Since 


the state-complexity is Mk Q for both codes, it follows that for a given state- 
complexity and given rate, the maximum value of df ree is achieved within the 
subset of convolutional codes with M ■ 1. Hence, we can restrict our search 
for optimal codes, for a given rate and state-complexity, to codes with unit- 


memory . 

For a ur.it-memory code, equation (1) reduces to 

b ^ (t ■ 0, 1,2,...). (3) 

When a^O is the only non-zero information subblock, then 

■ VW (4) 

is the only possibly-non-zero protion of b^ Q ^ . From (2), it then follows 

that the attainable d^^ of a unit-memory (n Q , k Q ) convolutional code is upper- 

bounded bv the largest minimum distance of an (n = 2n , k - k ) block code. 

■ ■ - — — 1 ..... o o — — — — 

We shall call this upper bound the block code upper bound on ^£ re( , * a °d we note 

that McEliece and Rumsey [6] have used aim. lar arguments to derive more 

elaborate upper bounds on ^£ ree foi codes where M ^ 1. 

We see that the argume"r used above to establish ne block code upper 

bound on d^ ree suggests the following search procec or finding a non- 

catastrophic unit-memory (n , k ) cede with maximal u, : 

o o ircc 

(i) Set d equal to the largest d , achievable by anv (n ■* 2n , k = k ) 

Bin o o 

block code. 

(ii) Choose [G-.iG,] as the generator matrix of a (n ■ 2n , k ■ k ) block 
U 1 c> o 

code with d , ° d. If d, - d and the code is ion-catastrophic , stop, 

min free 

Otherwise continue with step (ii) until all block codes with d ^ ■ d have been 

exhausted. 

(iii) Reduce d by 1 and return to step (ii) . 

The above search procedure was carried out to obtain, for rates 1/4, 1/3, 


1/2 and 2/3 (which are the usual rates of interest in applications), a 
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non-catastrophlc uric-memory convolutional code with maximal df rpe for all 
acate-complcxltles of 6 or less. The values of df ree obtained are given In 
Table 1 where we also list, for comparison, the largest df ree attainable by 
a code of the same state-complexity having gcd (n Q , k Q ) ■ 1. The block code 
upper bound on dj- ree for each case is also listed. 

The codes with gcd (n Q , k Q ) » 1 that achieve the values of dj rce given in 
Table I may be found in Larsen [3] and Paaske [4]. The values of the block 
code upper bound on d^^, given in Table I, were taken from Calabl and 
Myrvaagnes [7] and from Helgert and Stinoff [8]. In Tabie II, we give the 
matrices Gq and or a non-catastrophic unit-memory code with maximal d^ rcf? 
at each place where Table I shows that value to exceed the &f Tee available from 
the best gcd (n , k ) ■ 1 code having the same .ate-complexity . 
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Rate 

State Complexity 

Block Code Upper 

Maximal d f of 

Unit-Memory e 6odes 

Maximal d 

(k /n) 

0 o 

(No. of State Variables) 

Bound on d. 

free 

bed (n , 
Codes 

1/4 

1 

8 

7 

7 


2 

10 

10 

10 


3 

13 

13 

13 


4 

16 

16 

16 


5 

20 

20 

18 


6 

24 

24 

20 

1/3 

1 

6 

5 

5 


2 

8 

b 

8 


3 

10 

10 

10 


4 

12 

12 

12 


5 

15 

15 

13 


6 

16 

16 

15 

1/2 

1 

4 

3 

3 


2 

5 

5 

5 


3 

6 

6 

6 


4 

8 

8 

7 


5 

9 

9 

8 


6 

10 

10 

10 

2 2/3 

2 

4 

3 

3 


4 

6 

6 

5 


ft 

8 

7 

7 


Table I. Maximal dj ree for a given state-complexity Mk^ of 

unit memory convolutional codes and of convolutional 
codes with gcc (n , k ) - 1. 
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Rate 

1/2 

1/2 

1/3 

1/3 

1/4 

1/4 

2/3 



C 


2 


8 4 10000111 

01001011 
00101101 
00011110 


10001011 

11100010 

10111000 

11010001 


10 5 1000011111 

0100001111 
0010011110 
0001011001 
0000110101 


1111111111 

1111000000 

0010110100 

1010011010 

0110101001 


15 5 lOOjOllllOHOlO 

01000O111101101 
001001011110110 
000101101101011 
000011110110101 


000111110010100 

001101100101010 

011001001100101 

110000011110010 

100010111001001 


? 8 6 111000110100110000 
011100011010011000 
0011J0001101001100 
000111100110000110 
100011010011000011 
110001101001100001 


000011000111001011 
000110001110010110 
001100011100101100 
011000111000011001 
11000011000 110010 
lOOOOllOOOlliOOlOl 


20 5 10000011111110011000 

01000101110111001100 
0010011011001110011U 

oooioinoiioonoooii 

00001111101100110001 


00011110100001100111 

00110011010110001110 

01100101101000111100 

11000010110011011001 

10001101011100010011 


24 


100000111110111010110000 

010000011111011101011000 

001000101111101110001100 

000100110111010111000110 

000010111011101011000011 

000001111101110101100001 


001111000101001011010011 
011110001010010110100110 
111100010100101100001 101 
111001101000011001011010 
11001 1010001110010110100 
100’ 11100010100101101001 


6 4 100001 

010010 
001011 
000111 


111100 

110110 

010011 

101001 


d 


free 


8 


10 


15 


16 


20 


24 


6 


Table 2. The encoding matrices of some non-catastrophlc unit-memory 

convolutional codes with free distance greater than the 

maximal free distance of gcd (n , k ) ■ i codes of the same 

o o 

rate and state complexity. 
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III. BYTE-ORIENTED NATURE OF UNIT-MEMORY CODES 


We no. show that short, unit-memory convolutional codes are "byte-oriented" 
in such a way as to be attractive for uae, with Vlterbi decoding, as the inner 
coding component of a cor- tenated coding system. 

In general, the state at time t of the convolutional encoder is the infor- 
mation sequence t _jj ■ : ••• over tl,e preceding K time 

units. Note that the successor of this state, namely, (a u ,.! ... :a , s a ] , 

, — t— rrrl — t—I — t 

k 

is already determined up to the 2 choices of , i.e., each state will have 

k 

2 ° successors in the "trellis" defined by the convolutional code (5], In 

the corresponding Viterbi decoder, the "metric" for the best path to each of 
Mk k 

the 2 ° possible states at time t must be relayed to each of its 2 successors. 

Hence, the value of k Q influences the overall complexity of the Viterbi decoder, 

although much less strongly then does the state-complexity. Nonetheless, to 

determine, for instance, whether the Viterbi decoder for an R ■ 1/3, M « 1, 

k • 6 code (state-complexity 6) is simpler than the Viterbi decoder for an 
o 

R - 1/3, M ■ 7, k “1 code (state-complexity 7) would require a detailed 
o 

analysis of the specific decoder design. 

With Viterbi decoding of convolutional codes, there is a natural segmentation 
of the decoded information digits into bytes of k^ bits, because the information 
byte a^ acts as a unit in determining the correct state. The typical decoding 
"error events" [2] give rise to the incorrect decoding of a small number of 
bytes, viz., the average number of non-zero information bytes in an information 


sequence ^ that generates an encoded sequence b^Q ^ of Hamming weight 

d„ . In an M - 1 code, this average is near 1, although there will generally 
free 

be about k / 2 bit errors per byte. In a code with k - 1, there will generally 
o o 

be a small number (say, about 3) of byte errors but, since a byte is a bit 
in this case, the same number of bit errors. However, if the information bits 
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with the latter code are gathered Into "bytes" of Mk Q - M bits, there will 

generally be about 1 7 "byte" errors per error event since the bit decoding 

errors arc not synchronised to begin at the start of these "bytes." Thus, 

even if both codes have the same state-complexity and same d. , one would 

expect the unit-memory code to have a lower byte-error probability for bytes 

of Mk bits, 
o 

To test the validity of these observations , we simulated Vlterbl decoding 

on an additive white Gaussian noise (AWGN) channel with several values of the 

energy per information bit to one-sided noise power spectral density ratio, 

Vo , for several convolutional codes of rate R - 1/3. The codes tested were 

(1) the k *6 unit-memory code of Table II, (ii) the k • 1, M - 6 code given 
o o 

by Larsen [3], and (ii.) the k Q ■ 1, M ■ 7 code given by Larsen (3]. The byte 

size was 6 bits. The results of the simulation are given in Table III. The 

unit-memory code (1) had a decoding byte-error probability about one-half that 

of the ged (n , k ) ■ 1 code (ii) with the same state-complexity (Mk • 6). 

00 o 

This superiority of code (1) over code (ii) is due mainly to its greater free 
distance, 16 as opposed to 15. But we also see from Table II? that the decoding 
byte-e rror probability of code (i) is about two-thirds that of code (iii) 
which has the same free distance 16 and greater state-complexity, 7 versus 6. 
This superiority of code (i) over code (iii) is due entirely to its byte- 
oriented nature. 

We conclude that the unit-memory codes, because of their byte-oriented 

nature, appear ttractive for use as the inner code in concatenated coding 

systems 19] where the outer code is a Reed-Solomon (RS) code over the alphabet 
k 

CF(2 °) , i.e. the bytes of the convolutional code are single digits for the RS 
code. For instance, code (i) above would be used with an RS code over GF(2^). 

We expect in the future to report in detail on the effectiveness of unit- 
■emory codes in such applications. 
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M«l, (18,6) code 


M-6, (3,1) code 


M-7 (3,1) code 


(dB) Byre- 95X Con- 
Error fldence 
Prob. 


Byte- 95X Con- 
Error fldence 
Prob. 


Byte- 95X Con- 
Error fldence 
Prob. 


1.00 0.02950 +0.00533 
1.25 0.01925 +0.00435 
1.50 0.01100 +0.00329 
1.73 0.00625 +0.00250 


0. Oh 37 5 +0.00681 
0.03250 +0.00561 
0.02325 +0.00477 
0.01275 +0.00350 


0.04000 +0.00619 
0.02250 +0.00469 
0.01400 +0.00372 
0.01025 +0.00319 




Table III. Byte-error probability for Vlterbl decoding 
of three R - 1/3 convolutional codes on a 
simulated AWGN channel. 
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